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Claims 

I claim: 

1 (Currently am ended) A m ethod for creating a linked list data structure to which prefetching can be 
applied in order to minimize the number cache misses endured during traversal, said method 
5 comprising the steps of: 

creating a parallel data structure consisting of a plurality of partitions (N) consisting of a plurality 
of sublists (P), associating a state vector (S) with the data structure to maintain the state of the 
traversal of each sublist, and maintaining the state of the last sublist to v/hich an element is 
added in a variable (H), whereby; additions are made to the 
10 the head of the list by decreasing the list head index to H - 1 modulo P and adding new nodes to 

the head of the list indexed by the thus updated value of the head index, 
pipelining the traversal ao-oss the TS/ partitions of the data structure; 
determining the prefetch distance required in order to traverse said data structure using the 
afcrementicncd pipelined traversal, said prefetch distance being detcnnined by the programmer, 
1 5 computed using pri<y art, or by the compiler; 

inserting prefetch instructions into the traversal loop body. 

2. (Original) The method for creating a data structure according to claim 1 wherein the data structure is 
provided as part of a library. 

3. (Original) The method for creating a data structure according to claim 1 wherein a data structure 

20 defined by an application is transformed by a compiler, said compiler performing the necessary steps 

to modify coresponding traversal code to perform software pipelined prefetching. 

4. (Original) The method of creating a data structure according to claim 1 wherein flie data structure is 
generated by a set of macros. 

5. (Original) The method of creating a data structure according to claim 1 wherein the method of creating 
25 such a data structure is supplied as part of a class library in an object oriented system . 

6. (Original) The method of creating a data structure according to claim 1 wherein the steady state loop is 
preceded by a prologue which performs no data structure traversal, but which does generate prefetch 
instructions. 

7. (Original) The method of creating a data structure according to claim 1 wherein the steady state \oop is 
30 followed by an epilogue in which no prefetch instructions are performed, but in which traversal of the 

data structure continues and possibly completes. 

8. (Canceled) 

9. (Currently amended) The method of constructir^ a hnked list according to claim l^wherein additions 
to the end of the list are added to the eaid of the sublist indexed by I modulo P and the list header index 

35 H updated to H + 1 modulo P. 

10. (Canceled) 

1 1 . (Currently amended) The method of constructing a linked list accOTding to claim S-l^wherein 
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a variable (T) holds the index of the last sublist to have an element inserted, 
an array containing P pointers, said pointers linking to the tail of each sublist, 
insertion at the tail of the list is perfonned by the method consisting of 

updating the list tail index (T) to T + 1 modulo P 
5 and adding a node to the sublist indicated by the new value of T, 

and whereby deletion from the tail of the sublist is performed by the method consisting of 

updating the list tail index (T) to T - 1 modulo P 

and deleting the node from the tail of the sublist indicated by the new value of T. 

12. (Currently amended) The method of traversing the linked Hst constructed according to claim I 
10 whereby the linked list is traversed by the method comprising the steps of 

prefetching the head of each sublist; 

initializing a vector (S) with the head of each subhst; 

traversing the list in a software pipelined manner by 

iterating over S and processing each node held in S, 
1 5 perforra ing the requested wo-k on each node held in S, 

updating each element of S to hold the next element in the ccaresponding sublist^ 
and issuing a prefetch for next node in each sublist. 

13. (Original) The method of traversing a tree according to the method of claim 1 wherein a tree is 
constructed as a forest of trees. 

20 14. (Original) The method of constructing a pre-order traversal tree according to the method of claim 1 
comprising 

a plurality of trees (P); 

an array in M^ich to store a pointer to the root node of each tree; 
a variable (T) holding the value of the last tree into which a node was inserted; 
25 the method of adding a node to the forest by assigning the value T + 1 modulo P to the variable T 

and using a normal insertion into the tree indexed by the value of T thus updated; 
the method of traversing the forest in pre-order fashion. 
15. (Currently am ended) The method of traversing a single free by creating a forest of subtrees by the 
method ccan prising the steps of 
30 initiating a level-order traversal startmg at the root, 

m aintaining an array of pointers to nodes in the tree in the course of the level-order traversal, 
discontinuing the level-order traversal when a number of ^btrees sufficient for effective software 
pipelined traversal has be^ achieved, the afor^entioned array of pointers thereby containing 
the pointers to the roots of the trees of a forest to whidi software pipelined traversal can be 
35 applied. 
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then prcxieeding with a traversal^ wherein a tree is constructed as a forest of trees, and subtrees 
pointed toby the afarementioned array of subtrees constitute the forest across which software 
pipelined traversals are perforraed. 

16. (Original) The method of traversing a single tree according to claim 1 5 wherein the children of each 
5 node encountered in the course of the level order traversal are prefetched. 

17. (Original) The method of deconstructing a tree into a forest according to claim 1 5 whereby 

a queue is used to hold the nodes of the current level of an in-order traversal of the tree, said nodes 
being added to said queue as they are encountered in the course of the traversal of each level, 

a second queue is used to hold pointers to the children of the nodes at the current level, 
10 said queues swap roles as the traversal transitions from one level to the next, 

and the forest is constructed from the subtrees rooted at the nodes pointed to by the contents of the 
aforementioned two queues. 

18. (Original) The method of traversing a single tree according to claim 1 7 wherein the children of each 
node encountered in the course of fee level order traversal arc prefetched. 

15 
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